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Abstract 

S. Artstein, K. Ball, F. Barthe, and A. Naor have shown (cf. [ABBN]) that if (Xj)j2. 1 are i.i.d. 
random variables, then the entropy of Xl+ ^X Xn , h(^ Xi + ^J~ Xn ^, increases as n increases. 
The free analogue was recently proven by D. Shlyakhtenko in [Sh]. That is, if (x J )JL 1 
are freely independent, identically distributed, self-adjoint elements in a noncommutative 
probability space, then the free entropy of xl+ ^d~ Xn , x(^ xl+ ^J~ Xn 'j , increases as n increases. 

In this paper we prove that if H(X i) > — oo (x( x i) > ~oo, resp.), and if the entropy (the 
free entropy, resp.) is not a strictly increasing function of n, then Aj (x\, resp.) must be 
Gaussian (semicircular, resp.). 


1 Introduction. 


Shannon’s entropy of a (classical) random variable X with Lebesgue absolutely continuous dis¬ 
tribution dpx(x) = p(x)dx, is given by 

H(X) = — ( p{x) log p{x)dx, (1.1) 

Jr 

whenever the integral exists. If the integral does not exist, or if the distribution of X is not 
Lebesgue absolutely continuous, then H(X) = —oo. 

The entropy can also be written in terms of score functions and of Fisher information. 
Take a standard Gaussian random variable G such that X and G are independent. Let 

X (t l = X + y/tG, t > 0, 


and let j(X^) = (J|)*(l) e L 2 (f_i X ( t )) denote the score function of X® 
Then 


H(X) = 


1 r 

2 7 0 


- lb(^ w )lll dt + \ lo g( 27re ). 


(cf. 


[Sh, Section 3]). 

( 1 . 2 ) 


The quantity ||j(AW)||| is called the Fisher information of I” and is denoted by L(Xw). 
Among all random variables with a given variance, the Gaussians are the (unique) ones with 
the smallest Fisher information and the largest entropy. 


* As a student of the PhD-school OP-ALG-TOP-GEO the author is partially supported by the Danish Research 
Training Council. 
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A. J. Stam (cf. [St]) was the first to rigorously show that if X\ and X 2 are independent 
random variables of the same variance, with H(Xi),H(X 2 ) > — 00 , then for all t £ [0,1], 

H(ViX 1 + VT~X 2 ) > tH(Xi) + (1 - t)H(X 2 ), 

with equality iff X\ and X 2 are Gaussian. It follows that if {Xj)J: i 1 is a sequence of i.i.d. random 
variables with finite entropy, then 


n 


H ( Xl+ ' 2 } X2n ) 


is an increasing function of n, and if it is not strictly increasing, then X\ is necessarily Gaussian. 
Knowing about Stain’s result, it seems natural to ask whether the map 


n 


H 


■Yi+-+.\y 


is monotonically increasing as well, or even simpler: Is H ^ A ' 1+ ~J| + ~ Y3 j > H y Xl ^ 2 j ? Surpris¬ 
ingly enough, it took more than 40 years for someone to answer these questions. Both questions 
were answered in the affirmative in [ABBN] in 2004. 

In this paper we extend Stands result by showing that if H(X\) > —00 and if for some 

n £ N, 

f XiH-hYn+i \ _ / XiH-hA'n 


/n+1 


y/n 


then X\ is necessarily Gaussian (Theorem 3.1). 

Free entropy, which is the proper free analogue of Shannon’s entropy, was defined by Voiculescu 
in [VI]. If x is a self-adjoint element in a finite von Neumann algebra M with faithful normal 
tracial state r and if fx x £ Prob(M) denotes the distribution of x with respect to r, then the free 
entropy of x, x(.x) £ [— 00 , 00 [, is given by 


X{x) = 


3 1 

log |s - t\dnx(s)d[i x (t) + - + - log(2vr). 


Exactly as in the classical case, x( x ) may be written in terms of the free analogue of the score 
function (the conjugate variable) and the free Fisher information. That is, if s is a (0,1)- 
semicircular element which is freely independent of x and if we let 


then 


X(x) = 


V) = x + Vis, t > 0, 


- 4>(x W ) d t + ^ log(2vre), 


(1.3) 


where ^(x^) is the free Fisher information of x®. In [V2] Voiculescu defines for a (non-scalar) 
self-adjoint variable y in (M, r) a derivation d y : C[y] —* C[y] <8> C[y] by 

d y (l) = 0 and d y (y) = 101. 

Then the conjugate variable of y. if it exists, is the unique vector 3(y) £ L 2 (W*(y)) satisfying 
that for all k £ N, 


(d(y),y k ) = (l®l,d y (y k )). 


(1.4) 
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That is, 3{y) = (d y )*( 1 < 8 > 1 )- The conjugate variable is the free analogue of the score function, 
and the free Fisher information of y is exactly ||('?/) |||, so that 


X(x) 


1 +1 


- 


Oh 


d t + - log(27re) 


(1.5) 


Note that if 3(y) = y, then the moments of y are determined by (1.4), and it is not 
hard to see that y is necessarily ( 0 ,l)-semicircular. 

In [Sh] D. Shlyakhtenko showed that if (xj)'*L 1 are freely independent, identically dis¬ 
tributed self-adjoint elements in (M, r), then the map 


is monotonically increasing in n. In fact, the method used in [Sh] applies to the classical case 
as well. In this paper we will dig into the proof of the inequality 

^(^J a- 6 ) 

and find out what it means for all of the estimates obtained in the course of the proof to be 
equalities. We conclude that if x( x i) > ~oo and if (1.6) is an equality for some n, then x\ is 
necessarily semicircular. With a few modifications, our method applies to the classical case as 
well. 

Acknowledgements. I would like to thank Dimitri Shlyakhtenko for introducing me to the prob¬ 
lem on monotonicity of entropy and for fruitful discussions about the subject. In addition, I 
would like to thank the UCLA Math Department, especially the functional analysis group, for 
their kind hospitality during my stay at UCLA. 


2 The Free Case. 

Recall that the (0,1 )-semicircle law is the Lebesgue absolutely continuous probability measure 
on M with density 

do-o,i(i) = 2“ - t 2 1[_ 2 ,2 ](t) d t. 

More generally, for /U, 7 G M with 7 > 0, the (//, ^-semicircle law is the Lebesgue absolutely 
continuous probability measure on M with density 

d = ^-j-y 4 7 -(t-fi ) 2 1^-277^+277] W dt. 

The parameters p and 7 refer to the first moment and the variance of <r^ )7 , respectively. 

Throughout this section, M denotes a finite von Neumann algebra with faithful, normal, 
tracial state r. We are going to prove: 

2.1 Theorem. Let n G N and let xi ,..., x n +\ be freely independent, identically distributed 
self-adjoint elements in (M, r). Then 

(x H- \-x n+ i\ /xi -1- \- x n \ 

H > ~ 7—vs —>' ( ’ 

Moreover, if x( x i) > — 00 , then equality holds in (2.1) iff x\ is semicircular. 
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Monotonicity of free entropy was already proven in [Sh]. Likewise, most of the results stated in 
this section consist of two parts: An inequality which was proven in [Sh] or in [ABBN] and a 
second part which was proven by us. 


2.2 Proposition. Let n G N and let xi ,..., x n +i be freely independent self-adjoint elements in 
(M,t) with t(xj) = 0 and ||a +2 = ||aq|| 2 > 1 < j < n + 1- Let oi,... ,a n+ 1 G R with a j = 

and let b\,, b n+ 1 G R such that bj Jl — aj = 1. Then 


<f> 


n +1 

E 

i=i 


a j x j j 


n +1 

< nV 6 ? 


i=i 


$ 


v /l ~ c 




aiXi 


Moreover, if d'fX+j ajXj) is finite for all j, then equality in (2.2) implies that 


( 2 . 2 ) 


n +1 




a,x,- = 


1*1112 

i=i 


n +1 

ll*HH ' 


i=i 


so that X^+i a j x j JS ( 0 » ||xi|||)-semicircu7ar. 


(2.3) 


2.3 Lemma. Let Pi,..., P m be commuting projections on a Hilbert space TC. Iff, i,. . ., £ m G 34 
satisfy that for all 1 < i < m, 

PiP 2 • • • P m fi = 0 , 


then 

m 

II Pifi + • • • + PmUW 2 < (m - 1) ^ II6.II 2 - (2.4) 

Moreover, if equality holds in (2.4), then G 0^+, where 


+ := + e w i p+ = j, Pjf = o} = (n p k m) n ppm. 


Proof. The inequality (2.4) is the content of [ABBN, Lemma 5]. The starting point of their 
proof is to write each as an orthogonal sum, 


6 


E 


p 

Se) 


ee{ 0 ,l} m \(l,l,...,l) 


where for e G {0, l} m \ (1,1,... , 1), 

£ G H £ := {C € % I Pjf = £jf, 1 <j< m}. 

Then 

Plfl + • • • + Pmfm = E E M. 

ee{ 0 ,l} m \(l,l,...,l)e»=l 

and 

1+lCl + . . . + PmfmW = E j|E PiPe 

£e{ 0 ,l} m \(l,l,...,l) e»=l 
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For fixed e 7 ^ (1,1,..., 1) there can be at most m — 1 i’s for which si = 1. Thus, by the 
Cauchy-Schwarz inequality, 




£ (En«eii) 2 <(m 

£i =1 


1) E ii p ^n 2 

£i = 1 


(2.5) 


with the second inequality being an equality iff the vector ||) £i= i (= (||£*||) £i =i) has m — 1 

coordinates and is parallel to the vector v = (1,1,..., 1) £ In particular, if the second 

inequality in (2.5) is an equality for some e £ {0, l} m with more than one coordinate which is 
zero, then (||Pj£* must consist of zeros only. It follows now that 


P\il + • • • + Pm£,m\\ 2 £ 


< 


(™- 1 ) £ Elicit < 2 ’ 6 ) 

e€{0,l} m \(l,l,...,l) £* =1 
m 

(m-l) ^ E ll«€il| 2 (2-7) 

eG{0,l} m \(l,l,...,l) i =1 

m 

(m-l)E E IISII 2 (2.8) 

i=l eG{0,l} m \(l,l,...,l) 
m 

(m-l)Ell^ll 2 - (2-9) 

2=1 


Moreover, equality in (2.4) implies that all the inequalities (2.5), (2.6) and (2.8) are equalities. 
Hence, 

(i) £* = PjQ for all e / (1,1,... , 1) and all 1 < i < m (cf. (2.7) and (2.8)), and 

(ii) by the Cauchy-Schwarz argument, for all e £ {0, l} m with more than one coordinate which 
is zero, ||£*|| = ||Pj£*|| = 0 for all i. 

Thus, if equality holds in (2.4), then £ Pj(lK) and £ 0 -^ Jfj, as claimed. ■ 

Proof of Proposition 2.2. (2.2) is the content of [Sh, Lemma 2]. Now, assume that equality holds 
in (2.2) and that a i x i) is finite for all j. We are going to ’’backtrack” the proof of [Sh, 

Lemma 2] to show that (2.3) holds. We will assume that |Xj \|2 = 1 for all j. 

With 

0 = M - ' = E aiXi ’ 1 < 3 < n + 1, 

V\ ' " J 

equality in (2.2) implies (cf. [Sh, proof of Lemma 2]) that 


n +1 


E a i X 


'3^3 


3 = 1 


n+1 

E«j 

3 =1 


n+l 


= n 


E iif. 


2 

■ j 112 - 


j=i 


( 2 . 10 ) 


Let M = W*(xi,... ,x n+ i). We now apply Lemma 2.3 to the projections E\,..., E n+ \ £ 

B(L 2 (M)) introduced in [Sh, proof of Lemma 2]. That is, Ej is the projection onto L 2 (W*(x \,..., Xj ,..., x n +i)). 
Note that the subspace "Kj defined in Lemma 2.3, 

= {£ £ L 2 (M) I E k i = £,k^j, Erf = 0}, 
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is in this case exactly L 2 (W*(xj)). Thus, the second identity in (2.10) and the fact that £j_LCl, 
implies that 

€ (§)(L 2 (W*(xi)) © Cl). (2.11) 

With E : L 2 (M) —> L 2 (M ) the projection onto L 2 (W*(Y2j a j x j)) we have (cf. [Sh, proof of 
Lemma 2]): 

n +1 n +1 

>(E«)=U^ (2J2) 

j =i l=i 


a,-Xi = 


The first identity in (2.10) then implies that E ^ £?) = Sj=i + aR d so 


» E 


CLjXj = 


n+1 n+1 

E^ G ©Ec^*+))©ci). 

1=1 *=i 


Now choose elements r/j e L 2 (IT*(a+) © Cl, 1 < j < n + 1, such that 


n+1 

a(E' 

l=i 


n+1 

S> 

1=1 


(2.13) 


Then 


n+1 n+1 


0 =[E a * X o E r h = E ( a i x iVj - r/i a j x j) ■ 

i = 1 1=1 #1 

A standard application of freeness shows that for (i.j) ^ (k,l), the terms cnxir/j — rjj/ijXj and 
a k x kVl ~ 7 lkO-i x i are perpendicular elements of L 2 (M). Thus, the above identity implies that for 
all i / j, 

aiXiijj = cijriiXj. ( 2 - 14 ) 

With L 2 (W*(xj))° = L 2 (W*{x j)) © Cl, 1 < j < n + 1, consider the free product of 
Hilbert spaces 


Cl© © 


L 2 (W*(xi 1 ))° ® L 2 (W*(xi 2 ))° 


'L 2 (W*( Xi J)° 


p> 1 l<ii,...,i p <n+l, 


and notice that Xi € L 2 (IT* +))° and rjj € L 2 (W*(xj))°. It follows from unique decomposition 
within the free product that there is only one way that (2.14) can be fulfilled, namely when rjj 
is proportional to Xj. That is, there exist ci,..., c n+ \ £ R such that rjj = CjXj and hence, 


» E' 


CLjXo = > CnXn 


(2.15) 


We can assume that ai,..., a n _|_i > 0, and then by (2.14), 

Cj = —!—=2-, 1 < j < n + 1. 


In particular, all the Cj’s have the same sign. Taking inner product with a j x j i n (2-15), 

we find that 


n+1 

E a j c j = 

1=1 


(2.16) 
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so that the c/s must be positive. Also, since Ylj aj = 1, we have that JT cj > 1. But 


n +1 

E c j 


1=1 


C 

a 


2 

i_ 

2 ’ 

1 


and so c\ > ai, and in general, Cj > aj. Then by (2.16), Cj = a,j, and (2.3) holds. As mentioned 
in the introduction, this implies that a j x j is (0,l)-semicircular (when ||aq ||2 = 1). ■ 


2.4 Corollary. Let x \,..., x n+ \ be as in Proposition 2.2 and let a i, • • •, a n+ \ € M with )T\- aj = 
1. Then 


X 


71+1 

E 

3 = 1 


CljX 


' 3 J '3 1 — 


77 + 1 

> V 


3 1 


^l 

n 


X 


TIE 




CLj Xj 


(2.17) 


Moreover, if a i x i) > — oo for all j, then equality in (2.17) implies that Ylj a j x j JS 

semicircular. 


Proof. The inequality (2.17) was proven by D. Shlyakhtenko in [Sh, Theorem 2]. Now, assume 
that X (£i# OjXj) > —oo for all j and that 


71+1 71+1 

x(X)w) = 2 

1=1 1=1 


n 


X 



Take (0,l)-semicirculars si,..., s n+ i such that aq,..., a? n+ i, si,..., s n+ i are free, and put 

x^P = Xj + VtSj. 


Then by assumption, 



71+1 

E 

l=i 


l - a] , 
n 


V 1 - 


\ ( 1 ) 
^Z^ aiX i 


*7^1 


4> 


71+1 

E 

l=i 


°l*j 


W 


dt = 0. 


(2.18) 


Applying Proposition 2.2 with bj = ^ yl — aj, we see that the integrand in (2.18) is positive. 
Thus, (2.18) can only be fulfilled if for a.e. t > 0, 


77 + 1 

E 


l=i 


1 - a j 
n 



<J> 


n+1 

E 

l=i 


a i x 3 


(t) 


(2.19) 


In fact, since both sides of (2.19) are right continuous functions of t (cf. [V2]), we have equality 
for all t > 0. Then by Proposition 2.2, Yl‘j=i a j x P i s semicircular. By additivity of the 31- 
transform, this can only happen if (CjT/ a j x j is semicircular. ■ 

Proof of Theorem 2.1. The inequality (2.1) was proven by D. Shlyakhtenko in [Sh], Now, assume 
that %(aq) > —00 and that 


X 


xi H-h x n+ i \ _ 

\Jn + 1 / 


xi-\ - hx„\ 

Vn ) 
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If we replace Xj by ii^_^ 3 )\\ 2 ’ we have equality. Hence, we will assume that t(x 3 ) = 0 

and that 11 11 2 = 1. Now, 


X 


x\ H-h% + i \ 

\Jn + 1 / 



and by application of Corollary 2.4 with a 3 = ^ i+l , Xl+ p' r ^f +1 must be semicircular. Additivity 
of the ^-transform tells us that this can only happen if x\ is semicircular. ■ 

We would like to thank Serban Belinschi for pointing out to us the following consequence of 
Theorem 2.1: 


2.5 Corollary. Among the freely stable compactly supported probability measures on R, the 
semicirle laws are the only ones with finite free entropy 

Proof. By definition, a compactly supported probability measure p on R is freely stable if for 
all n £ N, there exist a n > 0, b n £ R, such that if x\,. .. ,x n are freely independent self-adjoint 
elements which are distributed according to p. then 

-(Xl + • • • + Xn) + b n 

has distribution p. Note that the set of freely stable laws is invariant under transformations by 
the affine maps ((j> s ,r)seR,r>o, where 


4>s r(t ) = - , t £ R. 

r 

Also, by [VDN, p. 27], the semicirle laws are freely stable. 

Suppose now that p is a freely stable compactly supported probability measure on R. 
By the above remarks, we can assume that p has first moment 0 and variance 1. 

Let x\,X 2 be freely independent self-adjoint elements in distributed according to p. 
Since p is freely stable, Xl ~j^ 2 has distribution p as well (by the assumptions on p. 02 = \/2 and 
62 = 0). But then 



and by Theorem 2.1, either x{ x i) = — 00 , or x\ is semicircular. ■ 


3 The Classical Case. 

In this section we are going to prove the classical analogue of Theorem 2.1: 

3.1 Theorem. Let n £ N, and let Xi,... ,X n+ \ be i.i.d. random variables. Then 

x 1 + ... + x n+1 \ >H f xi±^± 

\Jn + 1 J y 




(3.1) 


Moreover, if H(X 1 ) > —00 and if (3.1) is an equality, then X\ is Gaussian. 



3.2 Lemma. Let n G N. Then for every m G N, the m’th Hermite polynomial, H m , satisfies: 


= E 

ki,...,k n >0, J2j kj=m 

Sketch of proof. (3.2) holds for m = 0 (Hq = 
m G N, 


771 ^ 

—— H kl ( Xl )H k2 (x 2 ) • • • H kn (x n ). (3.2) 

' • • • k n \ 

- 1) and for m = 1 (H i(x) = 2x). Now, for general 


H-m+iir) — 2xH m {x) 2mH m —\ (x). 


(3.2) then follows by induction over m. ■ 


3.3 Lemma. Let p G Prob(M) be absolutely continuous w.r.t. Lebesgue measure, and let at G 
Prob(M) denote the Gaussian distribution with mean 0 and variance t. Then if p{{— oo,0]) 0 

and p([0, 00 )) / 0, the following inclusion holds: 

L 2 (M, p* at) C L 2 (M, cr t ). (3.3) 

Proof. Let / G L X (R) denote the density of p w.r.t. Lebesgue measure. Then the density of 
p * at is given by 


d (p * a t ), 
ds 


s = 


y/2irt 


f(u) ■ e at • e * du ■ e 


- 


where 


u su 


/ OO 

f{u) ■ e _ 2 1 ■ e~ d u. 

-OO 

It follows that if (f> is bounded away from 0, then (3.3) holds. For s>0we have that 


(3.4) 


4>(s) > / f(u) ■ e at ■ e * du 

Jo 

r 00 2 

I _ u 

> / f(u) ■ e 2 1 du, 

Jo 


and similarly for s < 0: 


4>(s) > / f{u) ■ e 2 1 du. 


Since f 0 ^ /(u)du > 0 and / 0 °° /(u)du > 0, both of the integrals J 0 °° /(u) • e 2 * du and f(u) ■ 
2 

e 2 t du are strictly positive. This completes the proof. ■ 

Proof of Theorem 3.1. The inequality (3.1) was proven in [ABBN]. Now, suppose H(X 1 ) > 
—00 and that (3.1) is an equality. We can assume that X\ has first moment 0 and second 
moment 1. Take Gaussian random variables G\,..., G n +1 of mean 0 and variance 1 such that 
X\,..., X n+ \, G 1 ,.. •, G n , G n+ 1 are independent. Then with 


Xf =X j + VtG j , 
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h(^~, 


+X, 


n+l 


n+l \ _ 


Ll + t 




n 


/n+l 


2 dt + ilog(27re), 


where 


/ _i_ Y"(*) 

■( A 1 j -l~ A n+l \ _ 


n 


/n+l 


d v 


= ( d^ 


L M v (t) 


x; '+---+x, 


V n+l 


(*) 

n+l 


(3.5) 


(3.6) 


is the score function. Since X\ has mean 0 and finite entropy, gx 1 and gx 1 +-+x n+1 satisfy the 

\/n+1 

conditions of Lemma 3.3. 


For t > 0, define G L 2 (R n+1 ,(g)"'+ 1 /.f ( t >) by 


f {t \x i,...,x n+ i) = j( 


_ ■ ( + ^ t-^l+i A / xrj-l-Xn+i 


/n+l 


/n+l 


As in the free case (cf. (2.13)) equality in (3.1) implies that for each t > 0 there exists a function 
gW £ L 2 ( / u Y ( t )) such that f g^dg x g) = 0 and 


n+l 


/ ( d(xi,...,x n+ i) = ^2g [t \xj). 

3 =1 


(3.7) 


Because of Lemma 3.3 we can now write things in terms of the Hermite polynomials (H m )^ =0 . 
That is, there exist scalars (a m )“ =1 and {/3 m )m =l such that 


OO 

/ (1 )( x i,...,.x n+ i) = ^ 


771=1 


and 


+)( x ) = ^ p m H m (x). 


771=1 


By Lemma 3.2, this implies that 

71+1 OO 
j= 1 771=1 


E 


(Hr 


+ (n + 1 ) 2 


E 

7 1 . ■ ■ ■. fc n _|_i // 0 , 
Ej = "i 


m! 


h\k 2 \---k n+1 \ K1 


H kl (xi)H k 2 (x 2 ) ■ ■ • iLfc„ +1 (x n+ i). 


(3.8) 


The functions (H kl (xi)H k2 (x 2 ) • • • 7L fc „ +1 (x„ + i)) fclr .. !fcn+1 >o are mutually perpendicular in L 2 (A n +®"+<Ti). 
Fix m > 2, and take fci,..., k n +1 with ^ ■ kj = m and kj > 1 for at least two j’s. Then take 
inner product with H kl (x\)H k2 {x 2 ) ■ ■ ■ H kn+l (x n+ i) on both sides of (3.8) to see that a m must 
be zero. That is, 


•7++ !~-++i A ( gnj— \-x n+1 \ _ 


n 


/n+l 


/71+1 


= a\H\ 


Vn+l 


x\-\ - \-x n+ ! \ _ p +H- \-x„+i 


Vn+l 


Since the score function of a random variable X, j(X), satisfies (j(X),X) L 2 ^ x ^ = 1, we have 
that cti = and so 


-KY)+ \ / xiH-hr n+ i \ _ Xi-I-hx n +i 


/n+l 


/71+1 


/n+l 
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Then 


x, (1) +-+x 


(i) 

n+1 


/n+l 


has Fisher information 1, implying that it is standard Gaussian. As in the 


free case, using additivity of the logarithm of the Fourier transform, this can only happen if X\ 
is Gaussian. ■ 
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